課程資訊
課程名稱
消息理論
Information Theory 
開課學期
105-1 
授課對象
電機資訊學院  電機工程學研究所  
授課教師
王奕翔 
課號
EE5028 
課程識別碼
921EU1190 
班次
 
學分
全/半年
半年 
必/選修
選修 
上課時間
星期三2,3,4(9:10~12:10) 
上課地點
博理114 
備註
本課程以英語授課。
總人數上限:46人 
課程網頁
http://homepage.ntu.edu.tw/~ihwang/Teaching/Fa16/IT.html 
課程簡介影片
 
核心能力關聯
本課程尚未建立核心能力關連
課程大綱
為確保您我的權利,請尊重智慧財產權及不得非法影印
課程概述

Information Theory is a senior (undergraduate) level course designed for students who are interested in the quantitative fundamental limits of information. What is information and how to quantify information? What is the ultimate data compression rate and what is the ultimate transmission rate of communication? In this course, we introduce the fascinating theory originated from Claude E. Shannon, which addresses the above fundamental questions in communication theory. We will develop methods and coding techniques to achieve these fundamental limits. Finally, we will also demonstrate the application of information theory to other fields, including statistics (hypothesis testing and estimation) and statistical inferences 

課程目標
1. Introduce basic topics in information theory, including measures of information, source coding theorem, channel coding theorem, and source-channel separation.
2. Develop methods and coding techniques to achieve these fundamental limits.
3. Show applications of information theory beyond communications, especially in high dimensional statistics and statistical inferences. 
課程要求
Prerequisite: Probability, Linear Algebra,
Optional: Random Processes, Communication Systems
Homework (30%), Midterm (30%), Final (40%)  
預期每週課後學習時數
 
Office Hours
 
指定閱讀
Lectures will be based on lecture notes and slides. Further information about assigned readings will be provided in the first lecture.  
參考書目
1. T. Cover and J. Thomas, Elements of Information Theory, Second Edition, Wiley-Interscience, 2006.
2. R. Gallager, Information Theory and Reliable Communications, Wiley, 1968.
3. I. Csiszar and J. Korner, Information Theory: Coding Theorems for Discrete Memoryless Systems, Second Edition, Cambridge University Press, 2011. 
評量方式
(僅供參考)
 
No.
項目
百分比
說明
1. 
Homework 
30% 
 
2. 
Midterm 
30% 
 
3. 
Final 
40% 
 
 
課程進度
週次
日期
單元主題
第1週
9/14  Introduction; Measures of Information  
第2週
9/21  Measures of Information 
第3週
9/28  No Lecture (I-Hsiang out of town)  
第4週
10/05  Lossless Source Coding 
第5週
10/12  Lossless Source Coding 
第6週
10/19  Noisy Channel Coding 
第7週
10/26  Noisy Channel Coding 
第8週
11/02  Lossy Source Coding  
第9週
11/09  Lossy Source Coding  
第10週
11/16  Midterm  
第11週
11/23  Polar Coding 
第12週
11/30  Polar Coding 
第13週
12/07  Statistical Decision Theory  
第14週
12/14  Statistical Decision Theory  
第15週
12/21  Information Theory and Statistics  
第16週
12/28  Information Theory and Statistics  
第17週
1/04  Advanced Topics